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DETAILED ACTION 



; 1„_ ^AppNcantis rejguest^ .FinaL 
Office action mailed 8/27/2003 is persuasive and, therefore, the finality of that action is 
withdrawn . However, upon further consideration, a new ground(s) of rejection is made 
in view of Pierce et al., Ouhyoung et al. and Yamakita et al. 



2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

3. Claims 2, 12 , 13, 17-21, 36-40, 49, 51, 52, 75 are rejected under 35 
U.S.C. 102(b) as being anticipated by Pierce et al. (5,299,810). 

With regard to claim 2 Pierce et al. teaches a system (figure 1) comprising: a 

network (figure 2 items 77 and 78); a first computer coupled to said network (figure 2, 

item 74), said first computer comprising a first visual display (figure 2, item 42) and a 

first interface device capable of providing a first computer input (figure 2, "first interface 

device" including items 62, 66, 90 and 12), said first interface device comprising an 

actuator capable of providing tactile sensations in response to a haptic feedback signal 

provided by said first computer (figure 2, item 26 and column 1 , lines 50-55), said first 

computer developing a first image in a first gaming environment on said visual display 

that is associated with first stored tactile sensation information (figure 1 , item 114), 

wherein said first computer produces said first image and said haptic feedback signal 

based at least in part on information received from a second computer (figure 2, item 



Claim Rejections - 35 USC § 102 
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76) and based at least in part on said first computer input (column 1, lines 57-69 and 
_column2, lines .1-1 0). and said_ second computer. coupled tosaid network and 
comprising a second visual display (figure 2, item 44) and a second interface device 
capable of providing a second computer input (figure 2, "second interface device" 
including items 68, 72, 92 and 14), said second interface device comprising an actuator 
capable of providing haptic feedback in response to a haptic feedback signal provided 
by said second computer (figure 2, item 28), said second computer developing a 
second image in a second gaming environment on said second visual display 
substantially simultaneously with said development of said first image in said first 
gaming environment (figure 1 , item 1 1 0), said second image associated with second 
stored tactile sensation information (figure 2, item 28), wherein said second computer 
produces said second image and said haptic feedback signal based on information 
received from said first computer and based on said second computer input (column 1 , 
lines 57-69 and column 2, lines 1-10). 

With regard to means claim 12 Pierce et al. was shown above in regard to the 
rejection of apparatus claim 1 to have an apparatus that shows an equivalent means 
which reads on most of claim 12 language. In addition Pierce et al. teaches claim 12 
requires the "first interface device" to be a human/computer interface means and figure 
1 clearly illustrates a human interface. 

With regard to claim 13 Pierce et al. teaches a system as recited in claim 12 
wherein said second computer means input comprises at least one of a position input 
for said human/computer interface device, and a button click input (figure 2, item 90). 
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With regards to claim 49 Pierce et al. teaches a system as recited in claim 12, 

wherein said second computer means receives position information_from.said:first 

computer means over said network, said position information describing a position of a 
user manipulatable object of human/computer interface means included in said first 
computer means (figure 1). 

With regard to method claim 17 Pierce et al. was shown above in regard to the 
rejection of apparatus claim 1 to have an apparatus that makes the method of claim 17 
anticipated. In addition Pierce et al. teaches "wherein said first computer information 
comprises information representing a position of a user manipulatable object generating 
an image to be displayed on a visual display of said second computer" (figure 1 f items 
66 and 60) ; And further "haptic" is equivalent to tactile as used in claim 1. 

With regard to claim 18 Pierce et al. teaches a method as recited in claim 17 
wherein said first computer information includes haptic feedback information indicating a 
tactile sensation to be output by said second haptic feedback device (figure 1 , item 58 
and figure 2 item 26). 

With regard to claim 19 Pierce et al. teaches a method as recited in claim 17 
further comprising sending second computer information from said second computer to 
said first computer over said network (figure 2, items 77 and 78). 

With regard to claim 20 Pierce et al. teaches a method as recited in claim 19 
wherein said second computer information includes said input information from said 
second haptic feedback device and haptic feedback information indicating a tactile 
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sensation to be output by said first haptic feedback device (figure 1 , item 58 and figure 2 

- item -26) . 

With regard to claim 52 Pierce et al teaches a method as recited in claim 19 
wherein said second computer information includes information needed to update a 
simulated graphical object provided in an environment running on first computer (figure 
1 , item 110 and 58). 

With regard to claim 21 Pierce et al. teaches a method as recited in claim 17 
wherein said image includes displaying a first graphical object controlled by a user of 
said first haptic feedback device, and displaying a second graphical object controlled by 
a user of said second haptic feedback device (figure 1). 

With regards to claim 51 Pierce et al. teaches a method as recited in claim 17 
wherein said first computer information includes information needed to update a 
simulated graphical object displayed by said second computer (figure 1). 

With regard to method claim 38 Pierce et al. was shown above in regard to the 
rejection of apparatus claim 1 and method claims 12 and 17 to have an apparatus and 
method that makes the method of claim 38 anticipated. In addition Pierce et al. 
teaches wherein said second computer information comprises position information 
describing a position of a manipulandum of a second haptic feedback device (figure 1 , 
items 68 and 60). 

With regard to claims 36, 37, 39, and 40 Pierce et al. was shown above read on 
all limitation of these claims. 




Application/Control Number: 09/1 53,781 Page 6 

Art Unit: 2675 

With regard to method claim 75 Pierce et al. was shown above in regard to the 
rejection of_apparatus claim 1 and method claims 12 ,17 and 38 to have_an apparatus, _ 
and method that makes the method of claim 75 anticipated. In addition Pierce et al. 
teaches "said information comprising haptic feedback information and position 
information for a graphical object displayed by said second computer" (figure 1 
illustrates graphical objects on two displays and items 110 and 1 14 correlate to haptic 
feedback). 

4. Claims 27 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Yamakita et al. Tele-Virtual reality of dynamic mechanical Model", Proceedings of the 
1992 IEEE/RSJ International Conference on Intelligent Robots And Systems, Raleigh, 
NC July 7-10, 1992. 

With regard to claim 27 Yamakita et al. teaches a method for providing physical 
interaction over a computer network (abstract and figure 1) comprising: enabling first 
information to be transmitted comprising an indication of movement of a first 
manipulandum (figure 1 , Actuator 1 ) coupled to a first computer (figure 1 , Controller 1) 
over said computer network (figure 1 , model) to a second manipulandum (figure 1 , 
Actuator 2) coupled to a second computer (figure 1 , Controller 2); causing a force to be 
applied to said second manipulandum based on said indication of movement of said first 
mampulandum (figure 1 , remote tug of war system also see figure 6); enabling second 
information to be transmitted comprising an indication of said movement of said second 
manipulandum over said computer network to said first manipulandum; and causing a 
force to be applied to said first manipulandum based on said indication of movement of 
said second manipulandum (figure 1 , remote tug of war system also see figure 6). 
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Claim Rejections - 35 USC § 103 



5. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 

obviousness rejections^sef forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



6. Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over Pierce 
et al. (5,299,810). 

With regard to claim 22 Pierce et al. does not illustrate a method as recited in 
claim 21 wherein said first and second graphical objects are paddles. He instead 
illustrates them being vehicles such as a car however since a boat is also a vehicle and 
further since boats can have paddles such a feature would be obvious and simply 
viewed as merely directed toward an obvious intended use of the Pierce et al. gaming 



7. Claims' 3-5, 7, 11, 23, 28, 29, 31, 41-48, 53-56, 58-70, 72-74, 76, 78-82are 
rejected under 35 U.S.C. 103(a) as being unpatentable over Pierce et al. (5,299,810) in 
view of Yamakita et al. Tele-Virtual reality of dynamic mechanical Model", Proceedings 
of the 1992 IEEE/RSJ International Conference on Intelligent Robots And Systems, 
Raleigh, NC July 7-10, 1992. 

With regard to claim 58 Pierce et al. was shown above to cover most of the 

limitations. However Pierce et al. does not illustrate "a server computer over a network" 

Pierce et al. instead use a local "common ram board" to create a network means for his 

two computers. 

Yamakita et al. illustrates in figure 1 two Sites 1 & 2 remote to each other 
transmitting and receiving haptic information to and from a satellite above where it is 
clear that the satellite functions as a server computer between the two computers. 



system. 
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It would have been obvious to one of ordinary skill in the art at the time the 
- invention was made to modify the Pierce et al. apparatus to use a server computer on a . 
network as taught by Yamakita because the feature of being able to play the game with 
other players at any location such as Japan and USA would clearly be desirable and 
therefore motivational to all users. 

With regard to claims 3 , 4, 1 1 , 41 the combination of Pierce et al. and Yamakita 
et al. do not illustrate the use of well known standards of practice such as TCP/IP 
protocols or sending information to Uniform Resource Locator (URL) and since the 
references lacks specific communication details it would have been obvious to one of 
ordinary skill in the art at the time of invention was made to implement these features 
because the combination of Pierce et al. must use some communication method and 
one would be motivated to use conventional methods of communication because there 
is less risk in using standards that are known to work. The examiner also serves official 
Notice that TCP/IP and URL existed before applicants effective filing data. 

With regard to claim 5 the combination of Pierce et al. and Yamakita et al. 
teaches a system as recited in claim 2 wherein said first interface device includes a user 
manipulatable object for receiving input from said user, said user manipulatable object 
being movable in two degrees of freedom (See Pierce et al. figure 2, item 62). 

With regard to claim 7 the combination of Pierce et al. and Yamakita et al. 
teaches a system as recited in claim 5 wherein said user manipulatable object is 
receptive to a finger of said user for manipulating said user manipulatable object in said 
two degrees of freedom (See Pierce et al. figure 2, item 62). 
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With regard to claims 44 and 45 the combination of Pierce et al. and Yamakita et 
al. was shown above to cover these limitations. 

With regard to claim 46. the combination of Pierce et al. and Yamakita et al. 
suggest a system as recited in claim 45 wherein said projectile includes a ball or puck 
because Pierce et al. does not state what the shape of his projectile is it would be 
obvious that it takes on common shapes such as ball like or puck like. 

With regard to claim 47 the combination of Pierce and Yamakita et al. suggest a 
system as recited in claim 2 wherein said image displayed in said second gaming 
environment includes a graphical object having a location based on position information 
received from said second interface device, said graphical object able to collide with a 
different graphical object displayed in said second gaming environment, said different 
graphical object having a location based at least in part on said information received 
from said first computer (see Pierce figure 1 items 1 10 and 58). 

With regard to claim 48 the combination of Pierce and Yamakita et al. suggest a 
system as recited in claim 2 wherein said image displayed in said second gaming 
environment includes a graphical object having a location based on position information 
received from said second interface device, said graphical object able to collide with an 
obstruction displayed in said second gaming environment (see Pierce figure 1 items 110 
and 58). 

With regard to claim 23 the combination of Pierce and Yamakita et al. suggest a 
method as recited in claim 21 wherein said first and second graphical objects are 
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displayed in a web page is viewed as an obvious feature of a network because the 
window opened up is considered the web page when talking to a remotejjser, 

With regard to claims 53-56 limitations were shown above by the combination of 
Pierce and Yamakita et al. 

With regard to claims 42-43 limitations were shown above by the combination of 
Pierce and Yamakita et al. 

With regard to claim 28 the combination of Pierce and Yamakita et al. teaches a 
method as recited in claim 27 further comprising developing an image on a visual 
display of said first and second computers, said image portraying a graphical 
environment at least partially responsive to said movement of said first manipulandum 
or said second manipulandum (SEE Pierce et al. figure 1 and figure 2 item 62 and 68). 

With regard to claim 29 the combination of Pierce and Yamakita et al. teaches a 
method as recited in claim 28 wherein said graphical environment includes a first 
graphical object controlled by said first manipulandum and a second graphical object 
controlled by said second mampulandum, and wherein when said first and second 
graphical objects interact in said graphical object, forces are applied to said first 
manipulandum and said second manipulandum (See Pierce et al. figure 1 and figure 2 
items 62 and 68). 

With regard to claim 31 the combination of Pierce and Yamakita et al. teaches a 
method as recited in claim 27 wherein each of said first and second information includes 
feel sensation information indicating a type of force sensation to be output (SEE Pierce 
et al. figure 2, items 26 and 28). 
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With regard to claims 59-70 the combination of Pierce and Yamakita et al. was 
shown above tore limitatipns. 

With regard to claims 72 and 73 the combination of Pierce and Yamakita et al. 
suggest a method as recited in claim 75 wherein said first computer is a client computer 
and said second computer is a server computer because it is obvious that when you are 
playing the computer instead of another actual user you would refer to one computer as 
sever and the other client. 

With regards to claims 74 and 76, the combination of Pierce and Yamakita et al. 
was shown above to teach all of these limitations. 

With regard to claim 77 the combination of Pierce and Yamakita et al. teaches a 
method as recited in claim 75 wherein said information received from said second 
computer includes visual information depicting a body part because Pierce shows a 
vehicle and it would be obvious to have people who have body parts inside. 

With regard to claim 78. the combination of Pierce and Yamakita et al. teaches 
method ,as recited in claim 75 wherein said visual display is updated by moving a 
graphical object within a graphical game environment based on position data received 
from said haptic feedback device, where a collision between said graphical object and a 
different graphical object can detected to cause said tactile sensation to be output (SEE 
Pierce etal figure 1, item 114). 

With regard to claim 79 the combination of Pierce and Yamakita et al. teaches a 
method as recited in claim 75 wherein said first computer receives an indication of a 
gaming event in said information, said first computer synchronizing said visual display 
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associated with said gaming event with said tactile sensation that is associated with 
said gamingevent(SEE Pierce et al. figure 1 , item 114 and 1 10). 

With regard to claim 80-81 the combination of Pierce and Yamakita et al. 
teaches a method as recited in claim 79 wherein said gaming event is a collision, 
explosion (SEE Pierce et al. figure 1 , item 1 14 and 110). 

With regard to claim 82 the combination of Pierce and Yamakita et al. teaches a 

method as recited in claim 79 wherein said visual display is updated at a rate 

substantially faster than said tactile sensation (SEE Yamakita et al. abstract). 

8. Claims 6, 8, 14-15, 25, 33-34, and 89 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Pierce et al. (5,299,810) in view of Ouhyoung et al. "A low- 
Cost Force Feedback Joystick and its use in PC Video Games", IEEE Transactions on 
Consumer Electronics, Vol 41 . No. 3, AUGUST 1995 pages 787-794 and Kelley et al. 
"MagicMouse: Tactile and Kinesthetic Feedback in the Human-Computer Interface 
using an Electromagnetically Actuated Input/Output Device. 

With regard to method claim 89 Pierce et al. was shown above in regard to the 

rejection of apparatus claim 1 and method claims 12 , 17, 38 and 75 to have an 

apparatus and method that makes most of the apparatus limitations of claim 89 

anticipated. And in addition Pierce et al. teaches "a user manipulatable object 

moveable in at least one degree of freedom and operable to control a position of a first 

graphical object displayed by said first computer in a graphical environment ( figure 2, 

item 62 "Steering Handle" act as joystick for control of graphical "vehicle") at least one 

sensor operative to detect a position of said user manipulatable object in at least one 

degree of freedom" (It is clear that a steering wheel such as item 62 must have a sensor 

detecting its position in order for it to work and control the graphical object), 
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Pierce et al. does not illustrate the use of, "a local controller, separate from and 
-communicating with said-first computer, and. coupled to said actuator and said [sensor,. _ 
said local controller receiving haptic feedback data from said first computer", 

Ouhyoung et al. teaches a local controller with the above claim features in figure 
3b and note also used in a PC Video Game. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify the Pierce et al. steering wheel to have the above 
features as taught by Ouhyoung because Kelley et al on page 9 makes a motivational 
statement, "a dedicated microcontroller is employed to distribute the computational load 
and to afford adequate force feedback". 

With regard to claims 6 and 8 the combination Pierce et al. /Ouhyoung et 
al./Kelley was shown in claim 89 to read on these limitations. 

With regard to claims 14 the combination Pierce et al. /Ouhyoung et al./Kelley 
was shown in claim 89 to read on these limitations. 

With regard to claim 15 the combination Pierce et al. /Ouhyoung et al./Kelley 
teaches a system as recited in claim 14 wherein said second computer means sends a 
force feedback command to said local controller means that can be parsed by said local 
controller means such that said controller means can control said actuator means in 
response to said force feedback command in a control loop with said sensor means 
(See Ouhyoung figures 3b and 4). 

With regard to claim 25 the combination Pierce et al. /Ouhyoung et al./Kelley a 
method as recited in claim 17 wherein said second haptic feedback device includes a 
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local controller that communicates with said second computer, wherein said local 
controller parses a haptic feedback command sent by said second computer such that__ 
said local haptic can control said actuator in response to said haptic feedback command 
in a control loop with at least one sensor of said second haptic feedback device(See 
Ouhyoung figures 3b and 4). 

With regard to claims 33-34 the combination Pierce et al. /Ouhyoung et 
al./Kelley was found above to teach all of the limitations of claims 33-34 . 

9. Claims 84-88, 90, and 92-100 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Pierce et al. and Yamakita et al. as applied to 
claim 58 above, and further in view of Ouhyoung et al. "A low-Cost Force Feedback 
Joystick and its use in PC Video Games", IEEE Transactions on Consumer Electronics, 
Vol 41 . No. 3, AUGUST 1995 pages 787-794 and Kelley et al. "MagicMouse: Tactile 
and Kinesthetic Feedback in the Human-Computer Interface using an 
Electromagnetically Actuated Input/Output Device. 

With regard to method claim 97 the combination of Pierce et al. and Yamakita et 
al. was shown above in regard to the rejection of method claim 58 to have a method 
that makes most of the limitations of claim 89 anticipated. In addition the combination 
of Pierce et al. and Yamakita et al. teaches "each of said plurality of client computers in 
communication with the Internet" (SEE Yamakita figure 1 where claim term "internet" is 
broadly read to be any network), enabling said computer-game simulation of said 
particular client computer to determine if said first graphical object displayed on said 
client computer has collided with said second graphical object and determine a tactile 
sensation to generate if said collision has occurred (SEE Pierce et al. figures 3 and 4). 

The combination of Pierce et al. and Yamakita et al. does not illustrate, "wherein 
said haptic feedback device comprises a user manipulatable object, a movement of said 
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user manipulatable object tracked by a sensor of said haptic feedback device, and 

wherein said local model receives position-data from.said haptic feedback device 

describing said movement and sends haptic feedback data to said haptic feedback 
device". 

Ouhyoung et al. teaches a local controller with the above claim features in figure 
3b and note also used in a PC Video Game. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify the Pierce et al. steering wheel to have the above 
features as taught by Ouhyoung because Kelley et al on page 9 makes a motivational 
statement, "a dedicated microcontroller is employed to distribute the computational load 
and to afford adequate force feedback". 

With regard to claims 84-88, 92, and 94-100 the combination of Pierce et al. 
/Yamakita/Ouhyoung et al./Kelley was shown above to read on all of these limitations. 

With regard to claim 90 the combination of Pierce et al. /Yamakita/Ouhyoung et 
al./Kelley suggest a device as recited in claim 84 wherein said user manipulatable 
object is constrained to move in two planar degrees of freedom, wherein said actuator is 
a first voice coil actuator, and further comprising a second voice coil actuator, wherein 
said cursor is controlled by said user manipulatable object to select said displayed 
element on said web page (SEE Kelley figure 1 ) 

With regard to claim 93. the combination of Pierce et al. /Yamakita/Ouhyoung et 
al./Kelley suggest a method as recited in claim 97 wherein said first graphical object is 
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a representation of sporting equipment because Pierce et al. illustrates a car game and 
since race cars are the equipment used by race car drivers it reads on it. 



1 0. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Paul Bell whose telephone number is (703) 306-3019. 

If attempts to reach the examiner by telephone are unsuccessful the Technology 
Center 2600 Customer Service Office whose telephone number is (703) 306-0377 can 
help with any inquiry of a general nature or relating to the status of this application. 



Any response to this action should be mailed to: 



Or Faxed to: (703) 872-9306 

Or Hand-delivered to: Crystal Park II, 2121 Crystal Drive, Arlington, VA, Sixth Floor 



Conclusion 



Commissioner of Patents and Trademarks 
Washington, D.C. 20231 




Art unit 2675 
August 2, 2004 




